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INTRODUCTION * 

The following report is submitted by Garry R, Walz, Ph.D., and Libby 
TBenjamin, Ph.D. , of The University of Michigan, aa the final evaluation report 
on the Georgia' Comprehensive Career Guidance Project. It covers the entire 
period of the Project from January 1, 1975 to December 31, ^975, although the 
major emphasis is devoted to the concluding phases of the Project, e.g., the 
training packages. 

The report is divided into four sections: 

I. Overview of the Evaluation Process. * 

II. Guidance Team Training Packages evaluated for Feasibility, 
Transportability, and Validity. 

III. . Evaluation of Project Planning, Communication, and Implementati 
IV|. Summary, Conclusions and Recommendations. 




I. OVERVIEW OF THE EVALUATION PHOCESS 
The evajuation team had two major objectives: 

1. to assess the quality and utility qf the manual training packages, and 

2. to review and aniilyze procedures which led to the development and 
eventual Implc^mentatlon of the training packages. . * , * 

Perhaps the overall goal of the t^am was to attest to the quality of what . 
was produced and to identify the lessons in the manual production which could 
lead to improved training package development in the future, 



In responding to the objectives the team utilized six major procedures: 

1, The evaluation team were the recipients of correspondence, other 

written materialsv and quarterly reports developed by the State Department and / 

/" 

the University of Georgia Project staffs. These materials were analyzed to ; ^ 

provide the team with information on which to make judgments regarding the y 

■ ' ' 

progress of the Project. , ' , / / , 

-» ' \ 

2, . The evaluation team met with the Stat^ Tepartment and U^iverlbity 

/ 

of Georgia staffs to review with them their plans and. activities. These meetings 
helped to clarify the different. aspects of the Project an^ enabled the teanpL to^\^ 
obtain more information than could be gleaned from the written maWriala. * 

3, Questionnaires were prepared and administered to school persoxmel 
in the original 16 participating schools at the conclusion of the'workshops and 
training ^iseisions. By this means the team was able to assess objectively^. the 
experiences and reactions of the participants to the Project. . ^ 



4. Indivldiwil interviews and group discussions wfere conducted' with 
the staffs of the 16 participating schools to elicit their feelings regarding jthe 
strengths and weaknesses of the Piipject aiid where they felt improvements 
were needed. 

5. Progress Reports outlining all activities to date and assessiflg the 

*»• ' -» 

performance of the Project staffs were regulflirly distributed to Project staff 
members. This feedback procedure was designed to review progress with 
concurrent opport^mity to establish new procedures and goals based on tvhat . 
had been accomplished previously; * y 

6. ^ Information gained from computer searches of the ERIC system 

and visitations to comparable programs about the country pYovlcted the evaluators 

. * * --^ 

with a perspective irom which to view the present Project, The resulting 
insights were ud^ by the evaluators in judging the program and in making 
recommendations to the Prpject staffs. 

It would pnly seem appropriate in an evaluation report to first evaluate 
the evaluation process. In our judgment the evaluation, proceeded reasonably 
well. It was not alwiiys easy to obtain the needed i^ormation; on occasion the 
team .was uninformed about signifidant hSppenings; the team's schedule at times 
prevented their responding as promptly as "inight ^ve been desired. More 
important than any of the foregoing, the team believe that simple geographical 
distance precluded their hieing as involved in the ongoing development as they 
feel would iiave been contributive. Ope need not wait tUl the end of ^ rience 



to recc^Qlze the lessons inherent in it and to make the changes necessary to 

improve it 1 Notwithstanding the above shbrtcomUigs, the team believes that 

. ^ ■ . ^ 

the evaluation effort was successful in reaching its major objectives. 



4? 



n. GUIDANCE Team training packages 



General Description Overview ^ ' j ^ ^ ^ 

The-tljreiB training manuals to be evaluated in this report are 8-1/2" x 
11'^ size, with offset printing of double-spaced typescript. Each has a 

colorful cover, and the consents are sectioned color to correspond with 

— ' » ^ ^ • \ . 
various major portions of each manual. In addition, within' the sections designed 

for participatory activities, the material for the. leader of the traiiiing ^xperi^ngq 

is distinguished i4 color from that to be read and used by participants. Explana- 

tory key words are highlighted along the right margins of appropriate pages in 

the text. Each manuscript is 3-hole punched so that it may be inserted In a / 

loose-leaf notebook. 

Comments specific to each of the three training packages follow. 

/ ■ • . 



\ 



8 

ERIC 



EDUCATIONi^L ENVIRONMENT 

■ ' ' ■ ■ ' ■ ■ 

I V . Ill - 1- ■ ■ ■ ' . • , 

I ■ / > - 

A. Descriptive Overview , i ' v ' 

This. is a training manuaLof over 200 pagis, desigi^ed to promote 
guidance team member awareness and skillB in the functions th^it iriay be 
ibcli^ded in'an Educational Development Center, and, through experiential ^ 
exercises, to help the^team learn how to organize an^' develop such a Gente;r. 

^ The manual contains 34 hours pf planneji activities designed, In the ^ 
introductory phase, to promote sharing . and help ^rticipjants begin thinking . 
i^^riously about the impact of the environment. Subsequent experiences deal> . 
with assesi^ent of problems and the design of a tutoring program, and the bidk 
of the manual's contents is devoted to individual skill-building in Interaction ' 
Skilkr(8\activlties) and Learfflng Skills (13 activities) r^The remainder of the 



training paoka^ deals wi^ problent-solving^ educational planning, ^nd . 

1 ' C: ' ' 




enviromnental appraisal-, the final 10 ]^)&rs are spent in leari^g how to 
organize, plan facilities for, staff, and implement an Educaffbi)a^ Develobment 
Center. There are 39 didactic and experiential adtivities in the training Iptckagt 

This traioing manual is 6ne of three \i^ich were to be developed i^the 
Life Career Planning domain, the other two dealing with Planning Skills and 
Self Understanding. It is intended to be i^esponsive to three major goald as . 
identified in the Cjleorgia comprehensive needs assessment study: 

1. Study/Learning Skills ■ - ' 

2. ' Particip^tion/lnvolvenne^r^ills 

3. Baajlc Academic Skills \ <* / 



The manual concludes with an Appendix on Sociodfama, a section on' 
Resources (jpriorltized in order of suggested usefulness)^- and a bibliography 
o£ nine citations. , 



B. Three-^pronged Evaluation . 
1. Feasibility . ^ 

i;he extent to ^ich the paanual's goals and objectives are a<5hievabl^ and 

deliverable, its expectations can be realized, and its use u|i|der typical fi^ld 

> • ■ • ^ . 

conditions will be successful. ^ . 



12 3 4 5^6 7 ^ \ 

' Not at / . y Extreml^ly \ 

all Feasible ^ Feasible / * Feaiitble J 

The evaluation team gives this manual a rating of 5 on Feasibility. A discussion 

and rating of the differ eiat^ components whi^h led to the overalf ratjing follows. 

>.■■.-. 
a. Are the goals and objectives for this training packak^ clearly , - 

presented ? • * . . , 
No. Other than the general goals presented as. an outgrowth of 'the goals 

> • ' '\ --^ \ 

for each of the training packages which emerged from the Gfeorgia nteeds assess- 
ment survey, no specific goals forthis manual are giv6n. Si;r outcomes trom 
the orientation are stated in the Introduction, and the outcomes for the tratnlng 
section are presented in very general terms. Apparently, the two majo^ 
t>bjectives of the manual are to ^)repare team mefnbers in the functfohd necessary 
to operate an Edudalional Development /Center, '^^apd to teach them: how to organize 



and develop such a Center. q 



b. Are needed 6taf£ competencies speciifically identAed ? 

Not directly. In a sense, the 39 activities and the discussion of 
considerations in establishing an Educational Development Center do con- 
stitute competency arias which the authors believe team members should 
possess. However, the competency is expressed more in te^ms of whfit a 
student needs to be able to do rather thJin M^at a staff member needs ^ do to 

9 



facilitate student learning. ^ 



c. is the organization of the manual clear to the prospective leader? 
Generally. The manual is organized into three basic ^rts: the Intro- 



duction, the ^9 activities, a^d a concluding section on developing the Center^ , 
However, there are few transitional discussions or lead-ins from one activity 
to another. A helpful discussion is provided in ,tihe introductory poi^ion t6 the 
section on Center q^^ganization and development. No Table of Contents, except 
for the 'Table of Training Activities, exists to help the user locate specific 
portionW by piage number. t % ' ^ 



d. Are time limits realistici ^ ^ . 



Yes, with reservations. Completing the activities in the time limits 
^< provided calls for effective time management on the part of the ^facilitator and 

^ could he difficult wi^large groups and/or with groups that are »*turne<i on" by 

/ 

the experiences. Parentketigalty, the sessions are highly variable in time, 
ranging from 1/2 hour, to an hour, to an hour-and-a-half, perhaps proposing 
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■ ' ^ , Jt ^ . • • . 

problems to.a leader who would have to use the activities in the standard school 

< > 

period. ^ It.is Blao;woxpky of note that the total length of time required to complete 

> ' ,'. 

this manual^ 39 hours, may stretch the amount of time most users would find' 

... y ■ ■ . . 

' * • * 

feasible. . - ■ ,^ . 

^ 



e. Are tho^riianual activities relevant to the sjtated goals and 

^ ' ^ . • ^; ' ' . ' c 

objectTves ? . ' ^ 

' Yes, with qualification. The activities seem consisted with the gtoeral 
orientation given in the Introduction. Ho^wever^ goals and objectives, as 
mentioned in "a, " are not specifically outlined. 



f. Are the planned-for outcomes likely to be realistic? ^ 

Yes. The Lutended outcomes are not explicitly stated, but the activities 

do seem to be consistent with the PurposeVhich ih indicated for each activity. 

Further^ there is a cjesirable iiitermix ih the type of activities used and wha,t . 



is ^sked of the parti ci 



p^ts^ 



g. Is a means provided for additional ifgkding and knowledge-building 

by the Ifeader? ^ ' . 

. / V 

Yes. A body ofjl2 Resources is presentedjn order of "suggested. 

usefulness. The nati^re of the contents, and how ead^^^ource caA be useful, 

is riot indicated. . * . 



2. ^ Transportability , 

The extant to ^ich the manual is adoptable and usable in a variety of; : 
educational settings and levels and by personnel of varying backgrounds and 
ixperti8e.\ - ^ ^ ' ' - / 



'I 2 3 4 5 6 7 ' 

Not at all Extremely \. 

Tt^ansportable Transportable . Transportable 

T3xe evaluation team gives this manual a rating of^.5 on Transportability. A 

/- 

\ . ' ■ 

discussion and rating of the different components which led to the overall rating 

V 

follows. ^ * 

1 

a. Are the instructions to and expectations of the leaders clearly 

\ 

presented? ^ 

- -/ . 

Yes. 



b. Are the necessary resources and materials for the use of the 

-; ■ " '. . ■ I- ■ 

manual Included? A 

Yes. The comment as to the desirability of the need for more Informatio 
about each resource applies here as well. A number of resources and learning 
aids is included in the body of the manual and could prove Useful in the training 
experience. ^ 

/ ' 



/ .... 

c. Doeathe manual lend itself to use in a wide va riety of levels and 

settings ? ^ ^ 

Yes. It would appear to be useful irrespective of the level or setting in 

which it was to bef used. 

d. Is the information necessary to facilitate the manua l included in 
it? Is the manual self-contained ? 

Yes. It appears that all necessary materials and resources are included ^ 
in the training package. However, the means by which the individual can build 
knowledge and skills in the areas of his/her choice is not clearly specified. 

e. Is reference made to additional sources and materia ls for adapting 
or expanding the manual to specific environmental needs? 

Brief. A bibliography, which more appropriately should be called a 
reference section, is provided. These nine references are cited in the body 
of the manual. 

3. Validity . 

" The extent to which the manual builds upon objective knowledge, with 
content -which is both justifiable and relevant to the ends sought. 

X ' 



1 2 3 4 5 6 7 

Not Portions 

Valid - Valid Valid 
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The evaluation team gives this manual a rating of 5 on Validity. -A discussion 
and rating of the different components which led to the overall rating follows. 



a. Are the goals and ob^ctives in the manual appropriately drawn 
from known research and knowledge in»the area? ' 

It is difficult to say. As indicated previously, Specific goals atid 
objectives for this manual are lacking, and it is not clear why the particular 
activities were selelected for inclusion within the scope of educational 
environment. There is some question in our minds as to whether this manual 
needs to be as broadly defined in scope as ijt is. 



V 

b. Does the content of the manual reflect research and knowledge 
in each of the content areas 7 

Generally. Regular linkage is made to outside sources and experience 
for the content provided. This appears clearer and stronger to us in the area 
devoted to Interaction Skills than in that of Learning Skills. Support for the 
organization and development of an Educational Development Center is not 
buttressed by references to known theory and research or other experience. 



C. Discussion. 

This is an extensive training package with a wealth of activities for 

i ■ ■ - 

participants, including an emphasis on an Educational Development Center 

/ 

organization and ddvelbpment. Are we attempting too mubh? IVJay we, in the 



effort to cover everything, overwhelm the participant and in the process not 
really cover any one skill in depth? A more judicious selection of topics and 
delivery might well have streamlined this manual by as much as ^ne-third. 

In its defense, however, it can be said that it is a body of highly useful 
materials, and, given the opportunity for staff to pick and choose, it could be 
a valuable resource for them. The package probably could have been made 
even more valuable if consideration were given to. why particular sections and 
activities were included. Furthermore, clearer linking statements and 
discussions would have been helpful, as well as a simple explicit statement 
in the beginning as to the manual's organization and recommended use. 

The prime emphasis in the manual is the idea of an Educational 
Development Center and the use of the activities presented within that Center. 
In our view it would appear that both the utility and justification for the Center 
are not sufficiently explicated, nor is there ample discussion devoted to how 
the activities might best be u^^ in a school system that did not have such a 
Center. 



WORK AND LEIStJRE ENVIRONMENTS 

1 ■ , ' I 

A. Descriptive Overview , 

Work and Leisure Environments is an extensive training manual 
(approximately 150 pages) devoted to assisting workshop participants to 
analyze the relationship between work and leisure. The manual ^s intended to 
help staff acquire the knowledge ^d skills to be able to identify student ouk^ 
comes in the area of work and leisure environments and to select, develop, 
and implement various career-guidance processes for achieving those outcomes. 
Program sti:ategies for achieving student outcomes are also. highlighted. 

I^euty^seven hours have been allocated for participants^ become 
oriented to the area under discussion, experience 20 activities of a participatory 
nature, and complete several Postass,essment Instruments and two Attitude 
surveys. ^ 

The manual ha^ four parts: ^ 

1, Introdudfion and orientation; ^ 

2. Text and activities for trenda^and job classification systems, job 
expeX>tation.s and responsibilities, and leisure-related values, needs and 
abilities; ^ 

3* Strategies and objectives for realizing the skill and application 
objectives; ^ 

4. Summary activUies and postassessmept devices. 
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The bulk.oi the manual content, 22 hours, ac<xi.s with knowledge, skill, 
and application objectives. This manual is one of three >^ich were to be 
developed in the Work and Life ^U^domain, the other tw<5^dealing with Daily 
Living and Employability. It is intendecl to be responsive to three major goals 
as id^tified in the Georgia Comprehensive needs assessment study: 

1. Work Expectations and Responsibilities 

2. Recreation and Leisure Interests' 

3. Work World Structures. 

Also included in ftie manual are a reference section with 17 citations, 
and apperidiceS containing materials to be uSed during some of the activities. 

B, -Three-pronged Evaluation . 
1.;^ Feasibility. . ^ . 

Tfiie extent to which the manual's goals and objectives are achievable 

i ^ « ■ ' . , ^' .■ * * . . ' '^^ ■ • • 

V a^d deliverable, its expectations can be realized, and its use under typical 




, 3 4 5 6-7 

^ ^ ' Extremely 

Y 'an Feasible Feasible Feasible 

The emluation tea^n gives this manual a rating of 6 on Feasibility. A discussion 

ancj rating of the different components which led to the overall rating follows. 



"15 18 



a. Are the goals and objjBctives for this training package clearly 
presented ? 

i 

Yes, with qualification. They appear, to be present, but it is difficult to 
distinguish between the objectives for eventual student learners and those, for , 
work^shop participants. 

b. Are needed staff competencies specifically identified? . 

Yes. However, the workshop objectives as outlined In^t^e^lJ^st section 
do not appear to conform in^to to the competencies spokenfto in the intro- 
ductory section. ' ^ . * 

c. Is the organii&ation of the manual clear to the prospective leader ? 

/ 

To a large extent, the information and instructions Jieeded to prepare ^ 

staff and use the materials with students. are clear and understandable. However, 

' ^ t 

the intended purposes and uses of various sections of the manual are not 

explained, and the leader must spend a great deal of tirj amiliarizing him/ 

herself with the document in order to understand the relationship^between 

various sections and fully understand the intended procedures, 

... - . , ^ 

d. Are time limits realistic ? 

Yes, if the workshop leader has excellent time discipline and continues to 
move the participants along. In the hands of a casual le^er, time limits may be 
unduly optimistic, . 

-I ^ . ■ • 

i9 ■ 



objectives ? 

• Yes. The activities seem particularly w^\iiited to the intended 



outcomes. 



f. Are the planned for outcomes likely to be realized? 
Yes. . * 



g. Is a means provided for additional re ading and knowledge- 




building by the leader ? 

Yes, but limite«t.' The reference section contains 17 citations only, 
and a wealth o^ literature exists which could greatly enlarge and enhance the ' 
bibliography. ' . ' 



2. TranspoA tability . 

The extent to which th^ manual is.adoptable aq4 usable is a variety of 
educational settings and levels and by personnel of varying backgrounds and 
expertise. " \ . 



2 3 ,4 5 . 6> 

Not at all , . Extrenjely 

Traneportabie Tjj^insportable' Transportable 



The evalua,tion team give^ this manual a rating of 6. 5 on Transportability. A ' 
discussion and rating of the different components which led.to the overall rating 



follows. ' • 

. ' .17 20 



a. Are the instructions smd expectations of the leader clearly presented? 

^mewhat. There is a g^eat deal of information presented, and the color . 

> ' ' " \ 

coding used to distinguish the leader's materials from those of the participants 
is hefpful. Generally, the instructions relating to the activities are quite clear; 
but the organization, parti^arly as it relates to the orientation aiid the fiilSl 
assessment, lac^ks clarity in stating specific procedures to'be followed. 

b. Are the necessary resourceiS and materials for the use of the 
manual included ? 

Yes, althougji in a few instances (such as Activity 3) it is not clear 
whether leader is to be provided wi|h, or to obtain his/her own, ma ial s 
^om identified sources. 



• c. Does the manual lend itself to use in a wide variety of levels 
and settings ? 

Yes. It would seem well suited for high school students but could also 
be readily used with college students and adults. 

d. Is the information hj^cessary to facilitate the manual included in 
it ? Is the manual self-contained,? 

Specific Ins^uctions for the facilitation of the 20 manual aqtivities are 
succinctly presented. The desired resource materials such as inventories, 
checklists, etc. s^e provided, along with information on their use. 

. ) 
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e. Is ref erence made to additional sources and materials for adapting 
or expanding the manual^to specific .envlroninental needs ? / . 

Qualified yes, A reference section is provided, but its contribution to 
th^ majiual and furtl^er use by the leader ar6 not indicated qr encoilraged. 

' ■ • : . ■ ■ ^ ■ ■ 

3. . . Validity . ^ 

The extent to -^ich the manual builds upoij objective knowledge with 
content which is both justifiable and relevant to the ends sought. , 



1 2 3 4 '5 6 7 

. Not Portions 

Valid Valid Valid 

The evaluation team gives this manual acting of 6.75 on Validity. A fiscussion 

and rating of the different components which led to tl||| overall rating follows. 

I • ^ ... % 

-■. / ■ y _ 

a. Are the goals and obiecti>^s in the manual appropriately- drawn 
from known research and knowlejdge in the, area? 

Ves. The manual's goals and objectives are derived from the Georgia 
compj^ehensive needs ^ssessmenj; survey. In addition, the goals and objectijres 
reflect the professionally-determined emphases fpV training materials in tli 



woipk and leisure areas. 



I - b. Does the content of the manual reflect research and knowledge in 

/ ■ , . ■ ■ ■ 

each o f the content areas ? ^' , ^ 



• ^ Yes. The ^manual makes extensive use of authoritative sources as well 

, as materials f^m popular media for the de^lopm^nt of content-and * ^ . 
. ' ■ ■ . ^ ' . • ' •• ' . • . 

activifclfeS. Thje important conc6ptual content jin'thiB ^ork and Jeilsure a^eas is 

'A 'present in tjie m^ual. * » ^ / 

' J ■ • / ' ■ . 

*^ ' * ^ ' ■ . • ' ' » 

^ C . Digcussion, - - 

^ This is tan^preAsi ve training m^ual It isi substantive ^nd detailed, 

and deals in a coniprehensive maniia^ with the twin topics^of ^o^ and leisure. ^ 

We regatd-it as a distinct plussrt^hat this manuarprods the participant, to grasp 

the interrelationships between work and leisure and to deal with them in a 

futuristic manner. We know of no comparable resource that has either the 

breadth or the depth of this one. It is our overall expectsition that a/user would 

emerge from the experiences knowledgeable, possessed of usable (^Us, 

positive in attitude, and prepared to initiate a program, in work and leisure. 

That no other known resQuii|6e qdin do \s*iat this liianual can is a tribute in itself. 

However,* several aspects of the training manual are of some concern. 

First of all, there appears to be an unnecessarily large amount of pedagogy and 

confusion over the organization and presentation in the early part oi the manual. 

. . "I 

Terms such as "domain, " ''competencies^'' ''outcomes, " *goals, " "sub-groups, 
etc^ are presented interchangeably and in such profusion that the reader can 
scarcely be blamed for not alwaySsbe^ing sii)^ just "^at is the point of it all. 
Clearly, some simplification and ah^revA^jlon in the introductory pages would be 
helpful. / \<. 

^- ■ . ■ , • ' 
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Second, the specific instructidtfs for each activity seem clear enough. 

* ^ ^ - ■'■ \ • ' 

However, two changes would undoubtedly be J^lpful,- 

' 1. In the early part of the manual a^imple, explicit statement on 
its drg|anizationj«d recommended'dse.ihourd(be prpvided (see tb^ section on 
Summary; Conclu^ng and Recommendations). * ' 

.2. It is aiipar^ntly ass\^ed that the ^ser has sufficient background 

and knowledge' to Jcnow why 6acW«ctiyi^. ha^^ been selected and" what4ts purpose 

k t ■ ' • ■ • . 

is. Aelditional discussion in the lieader's materials would serve to insure a 

more consistent orientation to and understanding of the training package on the 
part bf^he leader. This we belie Ve to be crucial to reducing the variance in 
outcomes experienced by different participants with different leaders. ^ 
As a final point, the references in- this manual play a very small part. 
Many specifically usable resources, aS compared with theoretical discussions, 
are available through ERIC and are not contained In the p^rence section. .« 
tn addition, better use of the references listed could be accomplished by short 
descriptions of the cohtents in each ^nd a brief indicatj^on as to wh^^and how 
they could be used. 
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HUMAN TlEIA^pe&S ' ( 



, ^.-^ ^ Descriptive Overview ^ I 

training, with experieOtial exercise? fo acquaint themjwith the small group 
process and other teaching procediyrqs used in such programs. Ori comi)|etion 
of the training manual, it is intended that p^rticipajts be able US assess the 
function of human relations training in their schools, and design'^andimplement ^ 
the necessary procedures for instituting a hunian relations training program. 

The manual is approximately 150 pages in length and is divided into three 
maiir lotions: an introductory section on the history of and research in human 
relations training, a second and main section de^pted to^ skill development, and 
^C^ncludiQg section>^ implementation str^t^f^es. The doniplete package is 
planned to consume 21 hours of traiuing^p^riences. 

T^e Human Relations training package is one of three vdiich were to be 
developed in the Interpersonal Effectiveness domain, the other two dealing with 
Relating With Significant Others and Self -Validation, - It isnntended to be . 
responsive to three major goals as identified in the Georgia cpmprehensive needs 

assessment study: \ _ 

• \ 

1. • Trust and Intimacy ) 

2. Expr^psive and i'^sertive 
'3. Affiliation and Acceptance. 
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Also inclu^^ in the training package ar^ two lists of references and 
resources for moil^ lii^d^th stud^f the areas of hunlan relations that* 
readers might like to pur sue. ^ . * 

B. Three-pronged Evaluation . / / , 

1. 'FeasiJ^lity» ■ ^ ^ ^ ' 

- ' • *t ■ ^ ' ' * • 

The extent to which the manual's goals anclJDbjectives are achievable 

^ i ' ' ■ • ^ 

"^d deliverable, its expectations can be realized, and its use uiider typirfal 
fiel4 conditions j^ll be successful. 7^-^^- / 

: • ' ' 
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1 2 3 4.5 6 7 

Not at Extremely 
all Feasible Feasible Feasible 

The evaluation team gives this manual a rating of 6.7^ on Feasibility • A 

discussion and rating of the different components which led to the (Overall rating 

fallows . 



a. Are the goals and objectives for this training package clearly 
presented ? 

Generally. The purpose for each activity is clearly ^and succinctly 
presented, but objectives for the training manual (workshop staff training) are 
not expliciay stated. Therefore, while the leader and participant may be 
clear as to what is the expected outcome for each activity, they may be less sure 
about the plaimed-for outcomes for th6^ entire manual. 

■ / 26 : ■ 
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. b. Are needed staff competencies Bt)eciflcaUy identlfted? , 
No. General goals of acquainting participuits ^^wiHf, tl^^ Qxnall group 
^process and procedures used to teach human relations" ^re presented, but . 
specific skills and pompetencif^s are not ex^icitljr stated. 

c. Is the onCTtnization of the n^anual clear to the! prospective, leader? 

■A ■ ' • ■ . 

Yes. The manual Is very clear in its organization and presentation. 
The user is 2^d£ly able to follow the flow and the content. 



d. Are time Mlnits r^listic ^ 

Questionable. Time Ufnits for^ whote sections are given, but the time 
estimation for eacl^^ activity is not provided. For an inexperienced leader, this 
could create a problem in knowing Jiow long to spend on each activity. 



e. Are the manual activities y^levant to the stated goals and objectives ? 
Qualified yes. The activities seem tO' relate very well to the purpose 

as stated at the outset of the activity. Sj^edfic goals and objectives, as stated 
before, are not given for the training package. , ^ 

f . Are the' plaxmed-for outcomes likely to be realized? 

■• 

Yes. The activities seem well designed and capable of producing the 

# • ... 

skills and knowledge necessary to respond to the intended outcomes. 



■J' 
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3. Validity . 

"^ ^e exXepi to whioh the manual builds upon objective knowledge with 
oentent which i« bbth justifiable and relevant to the ends sought. 



X 



1 2 3 4 5 6 7 

Not Portions 
Valid Valid Valid 

The evaluation team gives this manual a i^ting of 7 on Validity. A discussion- 

and rating of the different components which led to the overall rating follows. \ 

X ' * ■ 

1 

a. Are the goals acid objectives in the manual appropriately drawn 
from known research and knowledf^e in the area? \ \^ ^ 

Very much so. The manual exhibits high congruence .with and utilization 
of researched (experience in the human relations area. 

b. / Does the content of the manual reflf/ct research and knowledge 
in each of the content areas ? 

Yes. The same comment expressed In ^*a" applies here as well. 

' - ' • / ■ 

C, Discussion. 

*- ' * . ■ ■ 

This is a taut, well-written manual that exudes confidence that the user 
will be able to do Miiat th^. authors expect — namely , to implement human . . 

relations training in a (school setting. It accomplishes a great deal in a relatively 

■» ■ 

brief period of time. ir . , 

• ' ' 28 ■ ,, ■ 
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The section on Implementation Strategies is more detailed than^^ost 
and is a helpful adjunct to the section dealing with six areas of human relations 
skill development. Unique in its attention to {>rogram malntenancef the 
implementation section includes such important functions as the estabUshment ' 
of a support system througt^.the use of a Human Relations Comxbittee. 

Perhaps the only serious omission in our Judgment is communication 

^' ■ 

r^ardlng the outcomes early in the package so that the user knows at thjg 0(itset 
.VfbJBit it is a/he will be able to do on completing the training differently or better 
than a/he does now. 

Particularly worthy of note is the focus on implementation broadly 
throughout the curriculum as well as specifically within a Human Relations 
Center. The competencies and skills spoken to in this manual l\ave the potential, 
therefore, to be useful to an entire faculty or sjaff, whatever their responsibilities 
may be, simply as a way of promoting positives human relations and interaction.^ 
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III.^ . EVALUATION OF PROJECT PLANNING, COMMUNICATION AND 
IMf^LEMENTATION < 



At specified Intervals tlurlng the Project the evaluaition team discussed 
.Project progress with the Georgia State Department staff, the University of 
Georgia staff, and staff from the 1^ participating Title m schools. These 
contacts provided opportunity for tfie evaluation te&m to observe and assess 
the effectiveness of the overall Project management: 

1. Planning, or the preparation for the initial Introduction of the 
Project and the introduction of different phases during the Project; 

2. Communication and sharing of Information and Ideas between and 
among different mlllnbers and levels of the total Project; 

3. Implementation, or the introduction of the different program 
elements, including the workshops and training sessions. 



Every opportunity was used to assess thre effjectlveness of the ProjiBct 
in regard to the aforementioned management functions. However, it should 
be emphasized that, unlike the manuals, the management functions did not 
result in a highly specific and identifiable product that co^d readily be analyzed 
and evaluated. Therefore, what will be provided here is a series of system- 
atically formed judgments based on interviews and discussions with all parties 
. in the Project. These represent the best judgment of the evaluation team as to 
how the management function was carried out. It is^ntirely possible that others 

29 
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performing the same task could arrive at different conclusions^ but they are 
offered In the sipirit of encouragl^ both a review of v^at wa9 done and a 
consideration of what might be done differently in the future. 

1. Planning , 

By all observation it is apparant that considerable thought luad effort 
were given to Planning both pHor to the implementation of the Project and 
during the Project operation. ' Frequdnt meetings and discussions were held 
between and among the staffs of the State Department, the University 6t 
Georgia and the evaluation team. Actions were regularly planned and discussed 
before any implem^tation was attempted. Notably, considerable attention 
was given by the Georgia State Department staff to the evaluation effoirt; and 
when some initial problems arose in the evaluation process, the plan ^vas 
quickly reviewed and appropriate adjustments were made. Therefore, it seems 
fair to say that much effort was given to planning throughout the Project. 

One aspect of the planning, however, seenis to have been accomplished 

> less well than others.^ Unwittingly, the extensive pllUming led to efforts which > 
resulted in planning for the staffs in the participating schools rather than with 

^.them. Some of the school staffs seemed to feel as if a number of expectations 
Jiad been imposed upon them. Their "druthers" would have been to have had 
more involvement in deciding both the what and the how of what was to be done. 
A factor accentuating the feeling of external control on the part of some was 
what may have been, in retrospect, overly ambitious goals for the Project. 
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TMfi nefid to accomplish a gi'iBat deaMn .minimal time could have led, under- 
standably^ to very tight planning ^ich allowed less opportunity for input 
tliaa'Bome participants would have desired* % ■ ' , 

^ Overall, we would adjudge the planning aspect of the management to 
be extensive and generally effective. It could have ibeen imprc|\^ed had more 
opportunities been provided for involvement in and review of the planning by 
all of those affected by the planning process. , 



2. Communication. ^ ^ 

It was apparent from the very beginning that communications among 
members of the Projedt would pose a herculean task. Given the number of 

■ -X' ' 

people involved, the physical distance between them^ and their necessarily 

differing perceptions of and expeptktions for the Project, communications 

* 

were a continuing challenge. It is our judgment that ihe State Department and 
the Universlty^of Georgia Project staff were vefy fiSiibli aware of the Inherent 
difficulties and wdrked mightily to overcome Ihem. Numerous workshops anA, 
conferences werd held, written and verbal communication were regularly 
utilized^ and State DepcCrtmtent persbnne^ visited each school. 

) 

A separrate problem in communication related to the receipt by the 
evaluation team of sufficient data and,materlals from the University of Georgia 
Project staff to complete the planned process and summative procedures. Some 
of the tardiness in the transmission of these documents was undoubtedly due to 

.] " ^^^^ 9 

the delays experienced by the Project staff in receiving the materials that others 
had contracted to. produce. ^ 
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Pexliaps t£ie fairest juflgment'that can be made is that these efforts did 
nuch to keep people in communication with one another, but in the final 
analysis most of the participants at all levels found the cpmmunloation to. be 
lacking in some respects. 6f particular concernto n^y people was the need 
noT clearer communication concerning expectations and greater advance 
notification of events or activities. High marks iqhould be given tp both the 
State Department and the Univer^sity of Georgia Project staff for their Intei^st 
in and commitment to regular improvements in the] communication process 
during the life of the Project: . 



3. Implementation . ^ ' 

^ ■ f ' " 

The lixajor part of the implementation phase of the Project lies ahead. 

■ > • 

In essence, the total implementation of the full, icompreh^nsiye career guidance 
program requires 3 years from the point of its first Introduction into a given 



school. Thl^-seven schools are now involved ^n the program, with another 
20 proposed to^e added next year. \, 

. . . y-, 

The mosj; current data indicate that, three of the nine originaljly plaimed 

training manuals are now printed and available, three are in the process of « 

X V 

being printed, and three remain to be delivered to the printer. It should be. 

«^ . * 

noted, however, that the Project has produced two trainin^^ packages ^ich were 
not in the nine originally conceived, and the final 'series tq be produced will thus 

have eleven training packages in all. 

■^ •/ ^- ■ 

Specific training for the 37 partici^ting schools has already been 
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provided 4n Vocational Explanation Groups (VEG), the Life Career Deveiopment 
System (LCB^, and the Htanan Relations training manual. In addition, each of 
this sdhoolil has designed a staff development plan whereby it has used or \All be 
using the Educational Environment training manual this fall. Feedback from 
sta&s in the participating schopls was very favorable regarding their experiences 



In VEG and i^CDS. The participants saw these two training experienced as . 
supplementary and complementary to their other experiences in the Project^ and^ 
felt that they contributed desirable skills and compe^tencles in.career guidance. 

Implementation is where the pay-off on a project occurs^ Yet, because 
it occurs as the last ste^ in ai^ project, it i» mbst^subject to the presses and . 
the problems which inay have occured in the project^s development. An objective 

view of the Georgia project would reveal that the highly ambitious goals of the 

^ ^ ■ ^ ■ . '.-^ 

Project have made it difficult to complete the implementation phase withitf^t^e 

* . ' '■■ • ? 

prescribed timetable* From the point of view of a strict time schedule, it might 
be said that the implementation has not been successful. " Viewed,^ however, 
from the standpoint of initial groundwotk and accomplishments to date, one can 

be optimistic about the future. Ttie plan, the resources^ and the commitment 

ft 

to '^put it all togetl^^r'' exist. We feel that the probabilities for successM 
implementation are high, Sind^ we would rate the implementation effort as of 
limited success to date but of almost certain^ijprobabillty of success by the sumjner 
of 197V ' . c ■ 1 \ 
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IV. SUMMARY, CONCtUSIONS AND REGOMI^fiNliATIOl^S ' • 

A. . Sunuoixary . 

«JCbe Georgia Comprehensive Career 'Guidance Project is a notable 
example of a major state effort to develop training Ix^ specific needed guidance 
areas and to implement a comprehensive career guidance program. By^any 
definition it Would be an ambitious and exciting undertaldng.. It is our .overall 
judgment that the Project has successfully overcome initial problesM in 
start-up to provide both the str^icture and the content for making the compre- 
hensive career guidance program a laudatory. reality. 

The Project suffer^, and perhaps continues to suffer, from having « 
attempted to accomplish too much in too little time with too few resources. 
It would seem fair to say that what has been accomplished is worthy, and^at 
promises to be is at least as meritorious as that which has already occurred. 
The real test is yeM:o come,^,^ all of the training packages can be completed 
with the same high degree of quality as the three i^ich have been evaluated, 
and if every school staff caji be trained in their use and can obtain supplementary 
and complementary training in other areas of guidance^ the Impact of this 
pervasive staff development plan on'students, ifchools, and community shduld 
be profound. ' ' 

0 

B. Conclusions and Recommendation , 

It is our judgment that the training packages represent a significant 

■ 

contribution to staff development. ^>They are generally well organized, clear 



in exposition and substantive in cdktent. ' They ajtQ imique as a system in the 
jbreadth and comprehensiveness ol^ their coverage, llieir full usefplness, 

s ^ > • * 

hawevezv is yet to be Remonstrated. lVhUe|they give eyery a(%iearance^c!C > 

jarovldlng effective leamlngy.only field testing and assessment of the eventual { 

■ ■ . • ... • / ' \ ^ » " ■ 

outcomes will demon'strate their worth. 

' ' * . • • ■• ' 

■ / , " . . \ 

^ ^ * Each trainin^package clearly attempt&io relate the opnteht to the 

purposes set forth in the introductiop to the package. It 4s apparent that the 

'manuals have not been analyzed as to which topicis should be covered in each 

package, whether overlap exists in the coverage, fuxd^ether spi6e topics 

• • y ' • " = ^ ' " . ^( . 

should be eliminated fro^ specific manuals. Is each manudT to stand alone? 

'1 . ' * ■ ' ■ . ," 

Does one build on another? ftow do they relate to one another? We recommend 
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that the manuals be analyzed as to the overlap of the content and activities 
and that an assessment be made of wfaeth^ the overlap is desirable or undesirable. 
We further suggest that a document be prepared to accompany the training 
packages which would speak to the total Project goalee and the relationship of 
each of the packages to one another in the total series It should also Identify 
the specific gdals, objectives, and activities witliin each manual. In this way . 
the need to provide identical information in each of the training packages woulci 
be eliminated and the user would have an immediate grasp of the interrelationships 
and flow of the total program. In addition, because eacL manual evaluated in this 
report mentions the establishment of a learning^^Center, we suggest that such a 
generalized goal, and oth^r matters that pertain to all of 4he traiiiing packages, 
^e Incorporated into this ai^companying document, together iii^^i^the rationale 
supporting the suggestions. X 7 ^ 
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As mentioned above» each of the first three manuals csllt 4ot the 
^ / ' ' • • * ' ' ; . 

development of a special Centerrvin which to implement the activities. If 
\ ' ^ ' • ■ ' 

' subsequent manuals contlnuf^ tbis trendy the entire^chool budget could become 

' devoted^ to the support of special Centers. Clearly, any of the emphases and/ 

or recoznmendations which are of^red should^develop from a considerat^ of 

the mimuals as a total training systeml ^ . ^ 

The combination of participant materials and workshop leader Initructions 



In one manual seems unwise. Some prior experienqe would fuggest the desir- 



ability of providing a separate lea^et^s guide to accompany ^ch participant's 
manuaL This could reduce the bulk of the training package and also reduce thtf 
printing costs Since fewer leader's guides votild be needed. 

'Ili^ writl^ in tli^ znahiials is clear an Specific 
* exercises aire provided to achieve well-defined purposes^ However, unlike « 

other formsrdf learning, e.g., textbooks, lectures, and similar instructional 

V ' • ^ — 

devices, thene is little or'noydisgussion as to whythe t>articular purposes were 
selec^ or ^at the relationship is between various groupings of ;qu;tiviti6s. 
The partic^)aiit is asked to tajke a great deal^n trust. Little outside verification 
is offered for what the participant is asked to learn or vAxy the learning is 
^important. Would it not be essential in the training of school personnel that 
they, the leaders-to-be, know not only wW is important to Jo but why it is 
important as well? / we recommend that either In the manuals or in the training 
workshops more discussioA be provided regarding the ratioi|Ue for the selection 
of the topics ahd their relationship to each other. 

' ^ \ ' > ' . , ■ 
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Finally, we believe that the State of Georgia should sharecwith others 
about tb^^witry the pro^ct of their creativity, Intelligenoe, and peMeversuice. 
As a unique contribution to staff ^velopment draining, the materials developed ' 



and to be developed in ibis Project possess the potential to ^ihance greatly the 
quality of guidance services nationwide. , 

In conclusion, we believe that Dr. J^bn Dagley deserves great credit ' 
for his vision In conceiving the Project and his sHill in carrying it through, aiid ^ 
Dr. Faul^ail for his admirable ability to sort out; the important from the trivial 
and his never-ending capacity to overcome pitfalls and frustrations to reach the 
' desired end. 
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